OSCC/VI/Dec.l6 
12 October 1994 



Decision Number Sixteen 
to the Treaty on Open Skies 

Calibration of Ground Processing Equipment, Used for the 
Determination of H . From Video Cameras or Infrared Line- 

min 

scanning Devices and for Calibrating Ground-based Tape 
Reproducers Used to Replay Data from SAR Sensors 

The Open Skies Consultative Commission pursuant to the provi- 
sions of Decision 14 and Decision 15 to the Treaty on Open Skies (here- 
inafter referred to as Decision 14 and Decision 15 has decided as follows: 

This calibration procedure shall be followed to calibrate the 
ground equipment used to process and analyze data collected as a part 
of certification or demonstration flights. The calibration shall be done 
prior to these analyses. 

Annex A of this Decision provides a description of the Test Pat- 
terns to be used in calibration. Annex B of this Decision provides a 
description of the tests to be performed when an analogue framing 
video camera is to be certified using a ground video reproducer that is a 
different model from the airborne video recorder. Annex C of this Deci- 
sion provides a description of computer-assisted techniques which may 
be used pursuant to Decisions 14 and 15. These Annexes constitute an 
integral part of this Decision. 

Section I. Definition Of Terms 

The following definitions shall apply to terms used in this Decision. 

The term "line imaging device" means a device containing one 
line of detector elements for each wavelength band to be recorded. 

The term "frame imaging device" means a device containing 
either an electronic imaging tube or an array of detector elements for 
each wavelength band recorded which simultaneously form multiple 
lines of the image to be recorded. 

The term "video camera" means a passive black and white or 
color, line or frame imaging device, including the conversion of the 
image into electrical signals operating at optical wavelengths between 
0.3 and 1.1 micrometers. 

The term "image element" means the digitized signal representing 
the detected energy of a scene element within each wavelength band to 
which a video camera is sensitive which is stored in a frame store. 
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The term "scene element" means, in the case of a black and 
white video camera, the area on the ground that is projected on to a 
single detector element, and in the case of a color video camera, means 
the area on the ground projected on to the detector elements used to 
provide the different wavelength band data associated with that area 
on the ground. 

The term "image" means an array of image elements correspond- 
ing to an equally numbered array of scene elements which cover a 
contiguous area on the ground. 

The term "grey level" means the numerical value of an image ele- 
ment on an eight bit scale between zero and 255. 

The term "video densitometer" means a device or technique 
which is able to extract the numerical value of the grey level of individ- 
ual image elements from a frame store. 

The term "video display" means a monitor used for analysis of 
data pursuant to this Decision, including any associated image process- 
ing electronics, that is capable of displaying an image. 

The term "image processing system" means all ground-based 
equipment and software used to perform the visual or computer- 
assisted analysis of the images and determination of ground resolution 
and H . . 

mm 

The term "frame store" means a digital memory that is capable 
of storing at least a complete image of a calibration target where each 
individual image element is stored at a separate memory cell. 

The term "scan converter" means a device which has the capa- 
bility to selectively extract a frame or sub-frame of imagery from data 
produced by an infrared line scan device or a line-imaging device. 

The term "scan line" means a row of image or scene elements 
that are displayed or imaged sequentially. 

The term "line scan formatter" means a device which has the capa- 
bility to transfer a two-dimensional digital matrix that is stored in the 
computer into a series of scan lines that corresponds to the output of an 
infrared line scan device or a line imaging device or synthetic aperture 
radar, for the purpose of recording such data in line scan format. 

The term "frame grabber" means a device which has the capabil- 
ity to convert the output of an analogue video frame imaging device or 
analogue scan converter into an eight bit digital image for transfer into 
the computer and image processing system memory. 
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The term "frame formatter" means a device which has the capability 
to output data contained in a frame store to an analogue video recorder, 
in a format that simulates the output of a frame imaging device. 

The term "video recorder" means a data recording device capable 
of storing data collected by a video camera on magnetic tape without the 
use of encoding techniques. For digital recorders, data must be recorded at 
eight bits per wavelength band to which a video camera is sensitive. 

The term "video tape reproducer" means a device that plays back 
the information recorded on a video tape. 

The term "grey level difference function" means a software-based 
procedure that computes, summarizes and displays the differences in 
grey level that occur for each corresponding pair of image elements in 
two identically-sized images. 

The term "linearity of amplitude characteristics" means the mea- 
sure of the ability of a video tape reproducer to reproduce grey scale 
values in Test Patterns. 

The term "overshoot/undershoot characteristics" means the mea- 
sure of the errors produced by a video tape reproducer while reproduc- 
ing signals with large changes in grey scale values between adjacent 
image elements in Test Patterns. 

The term "bar" means, in the case of a digital Test Pattern, a rect- 
angular array of image elements, all of the same grey scale value. 

The term "bar width" or "width" means, in the case of a digital 
Test Pattern, the number of image elements across the bar in the hori- 
zontal direction (number of columns in the bar). 

The term "bar height" or "height" means, in the case of a digital 
Test Pattern, the number of image elements along the bar in the verti- 
cal direction (number of rows in the bar). 

The term "bar pair" means an adjoining pair of bars of the same 
width and height, but with different grey scale values. 

The term "light bar" means the bar in a bar pair with the larger 
grey scale value. 

The term "dark bar" means the bar in a bar pair with the smaller 
grey scale value. 

The term "bar group" means a sequence of adjoining 
bars of the same width and height whose grey scale values alternate 
between a single light value and a single dark value. A bar group may 
begin with either a light bar or a dark bar. 
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The term "spatial frequency", designated by f, means a frequency 
measure of a group of bars of bar width □ and is calculated by: 

f = 1/(2A) 

The term "bar group amplitude" means a measure of the grey 
level difference between the light and dark bars of a bar group. 

The term "image amplitude function", designated A (f), means 
the relationship of the bar group amplitude to the spatial frequency 
corresponding to those bars. 

The term "phase correction" means a technique to reduce scan 
line misalignments in the image caused by correctable time base errors 
in the video recorder, correctable motion compensation errors, or other 
errors which are camera induced. 

Section II. Calibration Procedure for Validating the Software and 
Computer System 

The following procedure shall be performed in order to verify 
that the software and basic image processing computer system are 
acceptable for performing the tasks required in Section 111 and for use 
in analyzing data from certification and demonstration flights. 

1. Tests of Image Processing System and Image Quality Acceptability 
Functions 

(A) Frame Store and Cursor Function/Video Densitometer 
Capability 

The six Test Patterns described in Annex A of this Decision 
and illustrated in Figure 1 of Annex A shall be transferred 
into the ground processing computer system and presented 
for viewing. The video display and associated frame store 
shall be capable of displaying all Test Patterns simultane- 
ously in a single image. 

(1) A visual analysis of the displayed Test Patterns shall 
be performed to ensure conformance with the visual 
characteristics shown in Figure 1 of Annex A of this 
Decision. The video display shall be viewed to deter- 
mine that no readily apparent distortion appears in 
the image and that all patterns can be simultaneously 
observed. 

(2) The cursor shall be positioned over the four corners 
of the video display containing the Test Patterns and 
the image co-ordinates and grey scale value at each 
location shall be recorded. The cursor locations and 
grey scale values of the four corners, relative to a co- 
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ordinate system which defines the upper left corner 
of Test Pattern 1 as (0,0), shall be (0,0) and 20 for the 
upper left corner; (511,0) and 230 for the upper right 
corner; (0,479) and 127 for the lower left corner; and 
(511,479) and 127 for the lower right corner. The cur- 
sor shall also be positioned at (25,0). The grey scale 
value shall be 20. The zoom function of the image 
processing system may be employed to assist in this 
task, but shall not change the image co-ordinates or 
grey level values. 

(B) Protractor Function 

The image processing software shall be capable of correctly 
calculating the angle between the rotated rectangle in Test 
Pattern 5 and any scan line in the image. The angle calcu- 
lated shall be 5 degrees +1- 1.0 degree. 

(C) Aspect Ratio 

The aspect ratio shall be determined for the rotated rect- 
angle in Test Pattern 5 by measuring its longer dimension 
and its shorter dimension in units of pixels. The result of 
dividing the longer dimension by the shorter dimension 
shall be 17.7 +1- 10%. 

2. Tests of Software Used to Determine the Suitability of Digital 
Tape Reproducers 

The ability of the image processing software to correctly deter- 
mine the differences between two separate images shall be verified by 
first loading the entire Test Pattern image into the image processing 
software and then storing this image into a separate image file out- 
side of the frame store used by the image processing system. This new 
image file shall then be loaded back into the image processing system 
and, using the software's grey level difference function, compared to 
the originally loaded image. Both a video display of the difference and 
the ability to quantify the magnitude of any grey level changes shall be 
provided. A grey level difference of zero for each image element shall 
be verified. 

3. Tests of Computer-Assisted Processing Techniques 

Any computer-assisted techniques used pursuant to Decisions 14 
and 15 shall be described in appendices attached to Annex C to this 
Decision. These appendices shall be provided by the State Party which 
sponsors the computer-assisted technique and shall include detailed 
procedures for validating, in accordance with the procedures of this 
paragraph, the computer-assisted calculations. Annex C describes the 
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computer-assisted techniques which may be used and is included as 
part of this Decision. 

(A) Validation of Image Amplitude Functions calculations 

Test Pattern 4 shall be used to confirm the ability of the 
software to calculate the Image Amplitude Function A(f). 
The A(f) shall be calculated by determining the amplitude 
of each of the bar groups in Test Pattern 4, as follows: 

(1) The amplitude a(i) shall be calculated for each of 
the i = 1, ...,36 bar pairs of Test Pattern 4 according to the 
formula: a(i) = 0.5 (Amax^(i) — Amin^(i)) where 

Amax^(i) is the maximum calculated grey scale value and 
Amin^(i) is the minimum calculated grey scale value of the 
ith bar pair of Test Pattern 4. 

(2) The image amplitude function A(fj) shall be defined 
for each of the j = 1, 12 bar groups of Test Pattern 4 
as the average of the amplitudes of the three bar pairs 
belonging to the jth bar group. 

(3) The calculated values of these functions shall lie 
within 1% of the correct values, provided in Table 2 
of Annex A, for every bar group. 

(B) Last Resolved Bar Group Validation 

The ability of the algorithm and software to correctly iden- 
tify the last resolved bar group shall be validated. 

(C) a^in Calculation Validation 

The ability of the software to correctly apply the formulas 
for Hmin for video cameras and infrared line-scanning 
devices, as specified in the Decisions 14 and 15, shall be 
validated. 

(D) Phase Correction Validation 

The ability of the phase correction algorithm and soft- 
ware to correct the known phase error in Test Pattern 6 of 
Annex A to this Decision shall be verified. This shall be 
done by first applying this algorithm on Test Pattern 6. 
The corrected pattern shall then be analyzed by generat- 
ing an Image Amplitude Function A(f) plot of the corrected 
pattern, as described in Section II, paragraph 3 (A) of this 
Decision. The A(f) plot values at bar group numbers 3 and 
13 shall be within 10% of the amplitude values stated in 
Annex A of this Decision for Test Pattern 6 for the pattern 
before the phase errors were introduced. 



182 



Section III. Calibration Procedures for Systems Which Employ 
Ground-based Video Tape Reproducers 

The specific procedure to be used shall depend on the type of 
output from the airborne video or infrared sensor system. Figures 1 
through 3 of this Decision provide the functional test diagrams for the 
four generic types of sensor systems: digital framing, digital line-imag- 
ing/scanning, analogue framing, and analogue line-imaging/scanning 
converted to digital. Paragraphs 1 through 3 of this section provide 
the details for calibrating the ground-based equipment associated 
with transferring the data from these four types of systems. Proce- 
dures for testing tape reproducers used to replay SAR data are also 
covered in the section on digital line-imaging. Only the tests directly 
related to validating the performance of the tape reproducer need to 
be performed for the SAR. These three paragraphs cover the testing of 
the tape reproducers and associated input/output equipment used to 
transfer the image from the tape reproducer into the image processing 
system used for determining the last resolved bar group and calculating 
H^j^. Paragraphs 1 and 2 detail the procedures for digital framing and 
digital line-imaging/scanning systems respectively, while paragraph 3 
deals with analogue framing systems. Data from analogue line-imag- 
ing/scanning devices shall be converted to digital and, therefore, the 
procedures of paragraph 2 shall apply. For sensors that produce output 
in more than one spectral band (such as a color imaging device), the 
appropriate procedure shall be separately applied to the output of each 
spectral band of the sensor. Any cables or special interface equipment 
to be used during certification or demonstration flights shall be the 
same as those used during this calibration procedure. In all of the tests 
of this section, the data shall be recorded on to magnetic tape of the 
same type to be used in the certification or demonstration flight, and 
at the maximum packing density to be used in an observation flight. 
If multiple tape types are to be used, each shall be tested separately. 
Prior to proceeding with the tests described in paragraphs 1 through 
3 of this section, the State Party responsible for performing the tests 
shall, by pre-testing, equipment selection, and/or care in maintaining 
configuration control be responsible for ensuring that: 

(A) The output of the computer shall be capable of simulat- 
ing the sensor output that is input to the airborne video 
recorder, to the degree necessary to ensure that all func- 
tions used to analyze data from a certification or demon- 
stration flight are present in the equipment and software to 
be calibrated. This may be done either directly or indirectly, 
via a device or technique such as a frame grabber, line scan 
formatter or frame formatter. The output of the computer 
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need not simulate the maximum output data rate of the 
sensor. 

(B) In the case where an analogue ground-based video tape 
reproducer is to be used to replay information collected 
and recorded on an analogue airborne video recorder, the 
ground-based video tape reproducer shall not introduce 
appreciable degradation of the data recorded by the air- 
borne video recorder. This shall be done by ensuring that 
the manufacturer's specifications for the quality of replay of 
such data are consistent with the airborne video recorder's 
recording capabilities. Further, they shall ensure that the 
ground-based video tape reproducer is properly adjusted 
such that the manufacturer's specifications for replay qual- 
ity are achieved. 

1. Calibration Procedure for Systems which use Digital Video Tape 
Reproducers for Playback from Digital Framing Type Sensors — 

See Figure 1. 

(A) The Test Patterns described in Annex A of this Decision 
shall be loaded into the computer system, transferred into 
the ground digital video recorder/reproducer and recorded 
on the video tape. If the ground-based digital video tape 
reproducer does not have a record capability, this procedure 
shall be performed on a video recorder of the same type 
used on the observation aircraft. 

(B) The image of the Test Patterns as generated on the tape in 
Step A of this paragraph shall then be replayed from the 
ground-based digital video tape reproducer back into the 
computer. The grey level difference function shall be used 
to compare this image to the original. The video recorder/ 
reproducer and associated input/output equipment shall be 
deemed acceptable if no more than three non-zero differ- 
ences/errors occur between the two images. 

2. Calibration Procedure for Systems which use Digital Tape 
Reproducers for Playback from Digital Line-Imaging/Scanning or 
Analogue Line-Imaging/Scanning Converted to Digital Type Sensors — 
See Figure 2. These types include video line imaging devices. Infrared 
Line Scanning Devices and Synthetic Aperture Radar Sensors. 

(A) The same procedure as described in Section III, paragraph 
1 (A) of this Decision shall be used to transfer the Test 
Patterns to the ground digital video tape reproducer. The 
Une scan formatter shall be capable of positioning the Test 
Pattern lines (480 lines of 512 image elements each) at 
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any location within the total number of lines and image 
elements per line of the format used by the line-imaging, 
line-scanning or SAR sensor. This shall be verified by using 
the line-scan formatter to position the Test Patterns at three 
different locations and then demonstrating the ability to 
extract the complete Test Patterns for display in the image 
processing system by means of the system's scan converter. 

(B) Using one of the images of the Test Patterns extracted via 
the scan converter as described in Section 111, paragraph 
2 (A) of this Decision, the same procedure as described in 
Section 111, Paragraph 1 (B) of this Decision shall be per- 
formed. It shall be verified that no more than three non- 
zero differences occur between the two images. In the case 
that obvious equipment malfunctions prevent meeting this 
criterion, the State Party owning the equipment shall be 
allowed to repeat this test after adjustment of the equip- 
ment and until the criterion is satisfied. 

3. Calibration procedure for systems which use analogue video tape 
reproducers for playback from analogue framing type sensors — 
See Figure 3. 

(A) Image Acquisition 

(1) Transfer the Calibration Test Patterns shown in Figure 
1, Annex A of this Decision via the frame formatter 
into the airborne video recorder and record on to the 
magnetic media for at least 10 seconds. 

(2) Playback the recorded image of the Calibration Test 
Patterns from the airborne video recorder used in step 
(1) of this subparagraph. 

(3) With the frame grabber, acquire images of the recorded 
Calibration Test Patterns from the airborne video 
recorder, and save them in files for later processing. 

(a) If the ground video tape reproducer is of the 
same model as the airborne video recorder, one 
image shall be acquired. 

(b) If the ground video tape reproducer is of a dif- 
ferent model from the airborne video recorder, 
two images shall be acquired. 
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(4) If the ground video tape reproducer is of a different 
model from the airborne video recorder: 

(a) Replace the airborne video recorder with the 
ground video tape reproducer, keeping all other 
components the same. 

(b) Move the magnetic media created in step (1) 
of this subparagraph from the airborne video 
recorder to the ground video tape reproducer 
and play back the recorded image of the Calibra- 
tion Test Patterns using the ground video tape 
reproducer. 

(c) With the same frame grabber used in step (3) 
of this subparagraph, acquire two images of 
the recorded Calibration Test Patterns from the 
ground video tape reproducer, and save them in 
files for later processing. 

Sampling Tests: 

Using any one of the images acquired in subparagraph (A) 
of this paragraph, the sampling capability of the frame 
grabber shall be checked to ensure that sampling of the 
played-back Test Pattern image occurs at an acceptable rate. 
The sampling rate for the played-back image of the test pat- 
tern shall be deemed to be acceptable provided that there 
are at least as many image elements across the displayed 
sensor frame as there are in each row of the Test Pattern. If 
sampling produces more image elements per row than exist 
in each row of the Test Pattern then, prior to performing 
tests in subparagraph (C) of this paragraph, if required, the 
images obtained in subparagraphs (A) (3) or (A) (4) of this 
paragraph shall be resampled to result in new stored images 
of the Test Pattern with each line having exactly one image 
element per Test Pattern column (512 total per line). 
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(C) Ground Video Tape Reproducer Tests: 

If the ground video tape reproducer to be used is of a dif- 
ferent model from the airborne video recorder, the ground 
video tape reproducer shall pass all tests specified in Annex 
B to this Decision before it may be used in the certification 
or demonstration flight data analysis. The original tape 
containing the imagery collected from these tests shall, 
upon request, be made available to other States Parties for 
further testing and verification following the certification 
or demonstration flight. This shall not delay the signing of 
the certification report or delay an observation flight. 

This Decision shall enter into force simultaneously with the 
Treaty on Open Skies and shall have the same duration as the Treaty. 
Decided in Vienna, in the Open Skies Consultative Commission, on 12 
October 1994, in each of the six languages specified in Article XIX of 
the Treaty on Open Skies, all texts being equally authentic. 
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OSCC/VI/Dec.l6 
12 October 1994 

ANNEX A 

to Decision Number Sixteen 
Test Patterns Used in Calibration 

The test patterns shall be obtained by the States Parties on remov- 
able magnetic disc from the OSCC, or shall be created based on the 
descriptions below. 

Figure 1 of this Annex illustrates the six test patterns that shall 
be used in the calibration process. The overall image size shall be 480 
image elements high by 512 image elements wide. Test Patterns 1, 2, 
3, 5 and 6 shall have as a lower border a rectangular region 5 image 
elements high and 512 image elements wide with grey scale value 
127. Test Pattern 4 shall have, as its lower border, a rectangular region 
6 image elements high and 512 image elements wide with grey scale 
value 127. Each test pattern shall be referred to by its own coordinate 
system, beginning at x = 0, y = 0 in the upper left corner. 

1. Pattern 1 

Pattern 1 shall be a rectangular region 75 image elements high by 
512 image elements wide, consisting of 15 adjoining bar groups. Each 
bar group shall consist of two bar pairs. All of the light bars shall have 
grey scale value 230 and all of the dark bars shall have grey scale value 
20. All bars in the pattern shall have the same height as the region. The 
width of the bars in each successive bar group, from first to fifteen shall 
be: 21, 16, 13, 12, 11, 10, 9, 8, 7, 6, 5, 4, 3, 2 and 1. The first bar shall 
be a dark bar whose uppermost left corner shall be designated as refer- 
ence position at X = 0, y = 0. 

2. Pattern 2 

Pattern 2 shall consist of 512 adjoining bars, all of height 75 
image elements, and all of width 1 image element. The grey scale 
values of the first 256 bars shall begin with 0 for the first bar and shall 
increase sequentially by 1 to 255 for the 256th bar. The grey scale 
values of the remaining 256 bars shall begin with 255 for the 257th bar 
and shall decrease sequentially by 1 to 0 for the 512th bar. 

3. Pattern 3 

Pattern 3 shall consist of 16 adjoining bar pairs of height 75 
image elements and width 16 image elements per bar. Table 1 specifies 
the dark and light bar grey scale values for each bar pair, beginning 
with a dark bar at x = 0, y = 0. 
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4. Pattern 4 



Pattern 4 shall be a rectangular region 65 image elements high 
and 512 image elements wide and shall have two components. The 
first component shall consist of a row of 12 adjoining bar groups, with 
all bar groups having the same starting (smallest) y = 2 coordinate. 
Each bar group shall consist of three bar pairs. All bars shall have a 5:1 
aspect (height to width) ratio. Starting with a dark bar, the bars in a bar 
group shall alternate from dark to light. The first bar group shall begin 
at X = 5, and shall have width 12. Table 2 specifies the width, height 
and dark and light bar grey scale values for each bar group. The bar 
group amplitude values are derived from the grey scale values of the 
light and dark bars in each group and are provided in Table 2. 

The second component of Pattern 4 shall be a noise region, that 
is a rectangular region 50 image elements high and 100 image ele- 
ments wide whose upper left corner shall be at x = 399, y = 34. The 
image element grey scale values in the noise region shall be randomly 
distributed. The distribution shall be gaussian, with mean 64, variance 
1.2 and two-dimensional correlation radius of 2.5. 



FIGURE 1 

DIGITAL TEST PATTERNS USED IN CALIBRATION 
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TABLE 1 

BAR GREY SCALE VALUES FOR TEST PATTERN 3 


B3r Group Nurnb6r 


Dark Bar Grey 
Scale Value 


Light Bar Grey 
Scale Value 


1 


0 


255 


2 


2 


253 


3 


4 


251 


4 


6 


249 


5 


8 


247 


6 


10 


245 


7 


12 


243 


8 


14 


241 


9 


18 


237 


10 


22 


233 


11 


26 


229 


12 


30 


225 


13 


34 


221 


14 


38 


217 


15 


42 


213 


16 


46 


209 



TABLE 2 

BAR CHARACTERISTICS FOR TEST PATTERN 4 


Bar Group 
Number 


Bar Width 


Bar Height 


Dark Bar Grey 
Scale Value 


Light Bar 
Grey Scale 
Value 


Bar Group 
Amplitude 


1 


12 


60 


60 


200 


70.0 


2 


11 


55 


67 


200 


66.5 


3 


10 


50 


74 


200 


63.0 


4 


8 


40 


82 


200 


59.0 


5 


8 


40 


91 


200 


54.5 


6 


7 


35 


101 


200 


49.5 


7 


6 


30 


112 


200 


44.0 


8 


5 


25 


125 


200 


37.5 


9 


5 


25 


138 


200 


31.0 


10 


4 


20 


153 


200 


23.5 


11 


4 


20 


170 


200 


15.0 


12 


3 


15 


189 


200 


5. 5 
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TABLE 3 

BAR CHARACTERISTICS FOR TEST PATTERN 6 


Bar Group 
Number 


Bar Width 


Bar Group 
Height 


Dark Bar Grey 
Scale Value 


Light Bar 
Grey Scale 
Value 


Bar Group 
Amplitudes 


1 


1 5 


60 


1 30 


240 


55.0 


2 


1 4 


57 


1 35 


240 


52.5 


3 


1 3 


54 


1 40 


240 


50.0 


4 


1 2 


51 


1 45 


240 


47.5 


5 


1 1 


48 


1 50 


240 


45.0 


6 


1 0 


45 


1 55 


240 


42.5 


7 


9 


42 


1 60 


240 


40.0 


8 


8 


39 


1 65 


240 


37.5 


9 


7 


36 


1 70 


240 


35.0 


1 0 


6 


33 


1 75 


240 


32.5 


1 1 


5 


30 


1 80 


240 


30 0 


12 


4 


27 


185 


240 


27.5 


13 


3 


24 


190 


240 


25.0 


14 


2 


21 


195 


240 


22.5 


15 


1 


18 


200 


240 


20.0 
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OSCC/VI/Dec.l6 
12 October 1994 

ANNEX B 



to Decision Number Sixteen 

Procedures for Calibrating Ground-based Tape Reproducers 
Which are Used to Replay Data from Analog Video Framing 
Camera and are of a Different Model from The Airborne 
Recorder Used With The Camera 

1. Analysis of Spatial Frequency Characteristics 

The purpose of this test is to measure the frequency content of 
the image that results from playing the recording made on the air- 
borne recorder on the ground video tape reproducer and to compare 
the results to those achieved by playing this same tape on the airborne 
recorder. The image amplitude function, A(f), of Test Pattern 1 in the 
captured video image shall be produced and the frequencies at which 
the amplitude falls below 50% (3 dB) and 10% (lOdB) of their peak val- 
ues shall be recorded. In obtaining these results, the following six steps 
shall be completed. 

(A) Using the video densitometer, no less than 5 adjacent pro- 
file cuts across Test Pattern 1 shall be made for each of the 

2 images obtained in Section 111, paragraph 3, subparagraph 
(A) (3) of Decision 16 to the Treaty on Open Skies (here- 
inafter referred to as Decision 16). These profiles shall be 
obtained from near the center of each pattern and shall be 
along the scan lines. Each series of profiles shall be stored 
in a separate file for later use. The file names used for each 
series of profile cuts shall be recorded together with names 
of the image files from which the profiles were made. 

(B) The average maximum value A max(i) and the average 
minimum value min(i) shall be calculated for each of the 
i = 1...30 bar pairs of Test Pattern 1 as follows: Amax(i) is 
the average (arithmetic mean) of the maximum grey scale 
values in the ith bar pair and A min(i) is the average of the 
minimum grey scale values in the ith bar pair, where the 
average is taken over all of the profiles obtained in subpara- 
graph (A) above. 

(C) The amplitude a(i) shall be calculated for each of the i = 1, 

30 bar pairs of Test Pattern 1 according to the formula: 

a(i) = Amax(i) - Amin (i) / 2 
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where A max(i) and min(i) are defined in subparagraph 
(B) above. 

The image amplitude function A(f.) shall be defined for 
each of the j = 1, 15 bar groups of Test Pattern 1 as the 
average of the amplitudes of the two bar pairs belonging to 
the jth bar group. 

(D) The steps in subparagraphs (A) through (C) above shall be 
repeated using the 2 images obtained in Section III, para- 
graph 3, sub-paragraph (A) (4) of Decision 16. 

(E) Graphs shall be plotted for the airborne recorder's image 
amplitude function. The bar groups where the airborne 
recorder's image amplitude function first falls below 50% 
(-3 dB) and 10% (-10 dB) of their peak values shall be 
recorded. 

(F) Graphs shall then be plotted for the ground reproducer's 
image amplitude function. The bar groups where the ground 
reproducer's image amplitude function first falls below 
50% (-3 dB) and 10% (-10 dB) of their peak values shall be 
recorded. For the ground reproducer to be deemed accept- 
able, the bar groups at which the 50% and 10% amplitudes 
occur shall be of the same width or narrower width (bet- 
ter frequency response) than the corresponding bar groups 
recorded as the baseline in subparagraph (E) above. 

(2 ) Analysis of Linearity of Amplitude Characteristics 

Linearity characteristics shall be quantified by the mean square 
deviation and maximum absolute deviation obtained from the differ- 
ences between the reproduced Test Pattern and the input test pattern, 
using Test Pattern 2 from Annex A of Decision 16 as the input. In 
obtaining these results, the following five steps shall be completed. 

(A) Using the video densitometer, no less than 5 adjacent 
profile cuts across Test Pattern 2 of Annex A to Decision 16 
shall be made for each of the 2 images obtained in Section 
III, paragraph 3, sub-paragraph (A) (3) of Decision 16. These 
profiles shall be obtained from near the center of each pat- 
tern. Each series of profiles shall be stored in a separate file 
for later use. The file names used for each series of profiles 
shall be recorded together with names of the image files 
from which the profiles were made. 

(B) The average airborne recorder value ^^(i) shall be calculated 
for each of the i = 1...512 bars of Test Pattern 2 of Annex A 
to Decision 16 as the average of the grey scale values in the 
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ith bar, where the average is taken over all of the profiles 
obtained in subparagraph (A) of this paragraph. 

(C) The procedure given in subparagraph (A) of this paragraph 
shall be repeated using the 2 images obtained in Section 111, 
paragraph 3, sub-paragraph (A) (4) of Decision 16. 

(D) The average ground reproducer value G^{i) shall be calcu- 
lated for each of the i = 1...512 bars of Test Pattern 2 of 
Annex A to Decision 16 as the average of the grey scale 
values in the ith bar, where the average is taken over all of 
the profiles obtained in subparagraph (C) of this paragraph. 

(E) Using the ideal values (i) for Test Pattern 2 of Annex A to 
Decision 16, (/jW = n-1, for n = 1...256, and I^(ri) = 512-n, 
for n = 257. ..512), the mean square deviations S^{I, G) and 
5^(1, A) and the absolute maximum deviations M^il, G) and 
M^{I, A) of the data obtained in subparagraphs (B) and (D) of 
this paragraph from the ideal shall be obtained as follows: 

5, (I, A) = Min X (^2 in + d)- A, {n)f , 

^'-^■^ n=l 

512 _ , 

S, {I, G) = Min X (n + d)- G, {n)f , 

fl'-^-^ n=l 

(/, A) = Min Max ll^in + d) -A^{n)Y , 

d=-3.3 n=1..512 ' ' 

M, (/, G)= Min Max U^in + d) - G2(n)Y , 

d=-3.3 n=1..512l I 

where = 0, for n<l, and {I^(n) = 255, for n>512. (The process 
of minimizing over a set of offsets "d" in the above equations 
arises from observation of phase misalignments between the 
ideal and reproduced patterns. The effect of phase misalignment 
is reduced by using the measures that arise from the best fit 
between the observed and reproduced patterns.) 

The ground tape reproducer shall be deemed acceptable in this 
test, if the mean square deviation of the ground tape reproducer 
is no more than 10% greater than the mean square deviation of 
the airborne recorder (i.e., S^(I, G)<1,2, • A) and the absolute 
maximum deviation of the ground tape reproducer is no more 
than 5% greater than the absolute maximum deviation of the 
airborne recorder (i.e., MJJ, G)<1.05 • M^ (/, A)). 

Analysis of Overshoot/Undershoot Characteristics 
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Overshoot/undershoot characteristics shall be quantified by the 
mean square deviations and maximum absolute deviations obtained 
from the differences between the reproduced Test Pattern and the 
input Test Pattern, using Test Pattern 3 of Annex A to Decision 16 as 
the input. In obtaining these results, the following four steps shall be 
completed. 

(A) Using the video densitometer, no less than 5 adjacent 
profile cuts across Test Pattern 3 of Annex A to Decision 16 
shall be made for each of the 2 images obtained in Section 
111, paragraph 3, sub-paragraph (A) (3) of Decision 16. These 
profiles shall be obtained from near the center of each pat- 
tern. Each series of profiles shall be stored in a separate file 
for later use. The file names used for each series of profiles 
shall be recorded together with names of the image files 
from which the profiles were made. 

(B) The average airborne recorder values, A^^in) and ^^^(n), 
shall be calculated for each of the n = 1...16 bar groups of 
Test Pattern 3 of Annex A to Decision 16 as follows. A.jj^(n) 
is the average of the grey scale values in the peak areas and 
/Ij^(n) is the average of the grey scale values in the trough 
areas of the nth bar group, where the average is taken over all 
of the profiles obtained in subparagraph (A) of this paragraph. 

(C) The steps of subparagraphs (A) and (B) of this paragraph 
shall be repeated using the 2 images obtained in Section III, 
paragraph 3, sub-paragraph (A) (4) of Decision 16 to obtain 
the values G.^^{n) and G^^^{n) for each of the n = 1...16 bar 
groups of Test Pattern 3 of Annex A to Decision 16. 

(D) Using the ideal values for the n = 1...16 bar groups in Test 
Pattern 3 of Annex A to Decision 16, I^^^(n) = 255-2n, I^^in) 
= 2n-2 for n = 1...8, and /^Jn) = 273-4n, I-^^{n) = 4n-18, for 
n = 9. ..16), the mean square deviations 53^(7, A), S^JJ, G), 
S.^^(I, A), and S.^JJ, G), and the absolute maximum devia- 
tions A), M,,^{I, G), M^^^{I, A) and M.^^(I, G), of the data 
obtained in subparagraphs (B) and (C) of this paragraph 
from the ideal shall be obtained as follows: 
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S3La^) = i^i;(l3L(n)-A3,(n)f 

n=l 
n=l 

S3Da^) = liX(l3D(n)-A3rf 

n=l 

n=l 

M,,{I,A)=Max\{I,,{n)-A,An) 

n=1..16 

M,,{I, G)=Max\{I,,{n) - G,,in) 

n=1..16 

A) = Max I (73o(n) - l3D(n) 
M3caG)=Max|(/3c(n)-G3o(n) 



The ground reproducer shall be deemed acceptable in this test, if 
the mean square deviations of the ground reproducer are no more than 
10% greater than the mean square deviations of the airborne recorder 
(i.e. S3J/G)<1.1 • S3^(/A) and S3|3(/G)<1.1 • S^^{I A) and the absolute 
maximum deviations of the ground reproducer are no more than 5% 
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OSCC/VI/Dec.l6 
12 October 1994 



ANNEX C 

to Decision Number Sixteen 

Computer-assisted Techniques for Calculating the 
Minimum Height Above Ground Level at Which Each 
Video Camera or Infrared Line Scanning Device Installed 
on an Observation Aircraft May Be Operated During an 
Observation Flight And Procedures For Validating Such 
Computer-assisted Techniques 

Any computer-assisted techniques used pursuant to Decisions 14 
and 15 to the Treaty on Open Skies (hereinafter referred to as Decisions 
14 and 15) and Section II, paragraph 3 of Decision 16 to the Treaty on 
Open Skies (hereinafter referred to as Decision 16) shall be described 
in appendices to this Annex. These appendices shall be provided by 
the State Party which sponsors the computer-assisted technique and 
shall include a description of the computer-assisted technique as well 
as detailed procedures for validating the computer-assisted calcula- 
tions. Appendix 1 to this Annex is the first computer-assisted tech- 
nique agreed by the OSCC. It provides an example of the details to be 
provided in any future appendix to this Annex. Additional appendices 
shall be included as a part of this Annex upon agreement by the OSCC. 
All computer-assisted techniques described in appendices to this annex 
shall be considered equally valid. 

In the case of demonstration flights, in accordance with Deci- 
sion 14, Section V, paragraph 1 (A) (2) and Decision 15, Section IV, 
paragraph 6, the Observing and the Observed Parties shall each be free 
to use a computer-assisted technique of its choice. If more that one 
technique is used, and the results do not agree, and the Observing and 
Observed Parties can not resolve the differences between the results, 
the visual technique shall be used. 

In the case of demonstration flights, in accordance with Deci- 
sion 14, Section V, paragraph 1 (A) (2) and Decision 15, Section IV, 
paragraph 6, an Observed or Observing Party which uses a computer- 
assisted technique: 

(1) shall provide the other Party the following data pertaining to the 
computer-assisted technique used: the name, size, date, and time of all 
of the executable and data files used, which are unique to the applica- 
tion, as obtained from a computer directory listing, and 

(2) shall make available to the Other Party a copy on disk of all of 
the executable and data files, including macros, which are unique to 
the application. 
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Appendix 1 
to ANNEX C to Decision Sixteen 

Amplitude Frequency Function (AFF) Computer-assisted 
Technique for Calculating the Minimum Height Above 
Ground Level at Which Each Video Camera Installed 
on an Observation Aircraft May Be Operated During an 
Observation Flight and Procedures for Validating the AFF 
Computer-assisted Techniques 

Pursuant to Decision 14, Section V, Paragraph 1 (A) (2) and 
Annex C to Decision 16, the following computer-assisted technique 
may be used. 

Section I. Procedures Used for the Determination of Resolution of 
The Video Cameras 

After completion of paragraph 4, Section IV, Decision Number 14 
the ground resolution for any configuration of video camera for the ith 
pass over the target is determined using a computer-assisted method in 
the following order: 

1 . From the test target image for each bar group a value of ampli- 
tude frequency function (AFF), designated by A(f, Hj, K, x.) shall be 
calculated, which represents the relationship of first harmonic ampli- 
tude in the target image from spatial frequency f=l/(2n), where □ is the 
width of the bar on the ground, or group number at given contrast on 
the target K, aircraft flight altitude H. and the atmosphere character- 
ized by transmission ni. To implement the procedure for the evaluation 
of the first harmonic amplitude an image or a mask of a given target 
should be used. 

2. From separate readouts obtained in paragraph 1 above a 
smoothed AFF curve A.{i, H., K,, z.) is created. 

3. A Threshold function (TF), designated by M{f,P^^^^), shall be 
calculated, which represents the relationship of the minimum value 
of the first harmonic amplitude, under which every target group will 
be resolved with a probability of error P^^^^^ , from a spatial frequency 
f . The TF is calculated on the basis of the evaluation of the correla- 
tion noise function of the video camera on the brightness fields of the 
target image, and its form depends on the target shape. 

4. The resolution is determined from the spatial frequency given by 
the intersection of the AFF and TF curves. 
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Section II. Procedure Used for Calculation of H . 

nun 

1. The AFF A.(f, H., K., x.) obtained for the ith pass above the target is 
recalculated to an agreed contrast = 0.4. As a result of this step a new 
AFF A.(f, H., K^, Xj) will be determined which corresponds to the aircraft 
flight altitude in the ith pass and for the agreed contrast. 

2. On a basis of AFF calculated for the agreed contrast a family of 
AFF |A^(f, H;,^, K^, xj) is calculated, k = 1,2 3,..., at the agreed atmo- 
spheric conditions which are characterized by transmission x^^ for every 
altitude H^j.. The set of altitudes Hik, for which the AFF is being recalcu- 
lated, is selected in such a way as to include the intersection of AFF and 
TF at agreed resolution A^^^^^^ = 30 cm. 

3. From the intersection points of the set of AFF Aj|^(f, Hj^, K^, x^^) 
and TF, M(f,P^^^^^), a curve of aircraft flight altitude under agreed con- 
trast and atmospheric parameters as a function of ground resolution 
H(A) of the video camera is prepared, which incorporates the value of 
agreed resolution, A^^^^^^ = 30 cm. From this curve a minimum altitude 
for a given pass shall be determined as: 

H . = H(A ^) 

mm 1 ^ agreed' 

4. The procedures described in paragraphs 1-3 of Section 11 of this 
Appendix shall be repeated for n passes when analyzing the image of 
a test target; n 3= 5 in case of certification and n 3= 1 in case of demon- 
stration flights. As a result, a set of minimum altitudes |H^^^.^..) will be 
obtained, where i is the number of a pass above the target and j = 1 for 
a target set across the aircraft track, and j = 2 for a target set along the 
aircraft track. 

5. H . value is used to calculate average values H .. from the 

mm i| <J min ij 

resolution evaluation across and along the aircraft track: 

TT 1 TT 

min j Tr~ ^mm ij 
i=l 

6. The minimum permissible altitude Hmin value for a given con- 
figuration of video camera is the largest of the values of minimum per- 
missible altitudes H^^^i and ii^^^2' obtained for a set of targets located 
along and across the aircraft track. 
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Section III. Procedure for Validation of a Computer-Assisted 
Calculation Of H 

min 

1. Software validation is conducted in two stages using the test pattern 
4 from Annex A of Decision Number 16. During the first stage calculation 
of the resolution is evaluated, during the second stage the accuracy of the 
H_^^.^ calculation is evaluated. Calibration input data given in Table 1 is 
entered for that purpose into the H . calculation software. 

^ ^ min 

2. Calculation of the resolution is validated as follows: 

(a) In accordance with paragraph 1, Section 1 of this Annex, an 
amplitude frequency function A(f, H^, K, x.) is plotted from 
the test pattern 4 image; 

(b) Noise characteristics of the equipment are measured along 
the noise field of test pattern 4, which should match the 
values provided in Table 2. 

3. In accordance with paragraph 2, Section I of this Appendix, the 
threshold function M(f,P ) is plotted. The intersection of M(f,P ) 

^ ' error' ^ ^ ' error' 

with the amplitude frequency function determines the resolved bar 
group, which must correspond to 11 for the AFF computer-assisted 
technique to be validated. 

4. The accuracy of the H calculation is determined from the 

^ mrn 

software output, which for the provided input data and the resulting 
H^.^ must be in the range of 830 to 870 meters for the AFF computer- 
assisted technique to be validated. 
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Table 1 


No. 


Parameter 


Calibration value 


1 


Width of a single bar in the first bar group 


0.6 m 


2 


Length of bars in the first bar group 


3 m 


3 


Bar widths reduction coefficient 


0.890899 


4 


Meteorological visibility (MV) 


10,000 m 


5 


Average reflectance of a dark bar 


0.4 


6 


Average reflectance of a light bar 


0.5 


7 


Ground illumination 


80,000 Lx 


8 


Equipment focal lengths 


30 cm 


9 


Linear dimensions of radiation detector 


1 2 |jm 


10 


Aircraft flight altitude 


400 m 


11 


Agreed value of MV 


10,000 m 


12 


Agreed value of reflectance of a dark bar 


0.2 


13 


Agreed value of reflectance of a light bar 


0.6 


14 


Agreed value of resolution 


0.3 m 


15 


Probability of error 


0.2 




Table 2 


No. 


Parameter 


Calibration value 


1 


Average value of equipment noise 


62 ... 65 


2 


Standard deviation value of equipment noise 


1.0 ...1.5 


3 


Correlation radius of equipment noise values 


2 ... 3 
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